Papers with multi-step logical reasoning
Reason-Code: Reliable Code Generation via Test-Driven Monte Carlo Tree Search (2026.acl-industry)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are widely used for code generation, but their performance degrades on complex tasks. |
| Approach: | They propose an inference-time framework that formulates code generation as a search process guided by execution feedback. |
| Outcome: | The proposed framework improves reliability without paying full cost of additional sampling under strict latency budgets. |
Explicit Planning Helps Language Models in Logical Reasoning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing systems that use pre-trained large language models to perform multi-step logical reasoning have been unable to perform this task. |
| Approach: | They propose a system that uses language models to perform multi-step logical reasoning and incorporates explicit planning into the inference procedure. |
| Outcome: | The proposed system outperforms other competing methods on multiple datasets and significantly outperformed chain-of-thought prompting on the PrOntoQA dataset. |
Multi-LogiEval: Towards Evaluating Multi-Step Logical Reasoning Ability of Large Language Models (2024.emnlp-main)
Copied to clipboard
Nisarg Patel, Mohith Kulkarni, Mihir Parmar, Aashna Budhiraja, Mutsumi Nakamura, Neeraj Varshney, Chitta Baral
| Challenge: | Existing logical reasoning evaluation benchmarks focus on simplistic single-step or multi-step reasoning with limited set of inference rules. |
| Approach: | They propose to use a multi-step logical reasoning evaluation dataset to measure their ability for human-like multi- step logical thinking. |
| Outcome: | The proposed dataset covers three logic types including propositional, first-order, and non-monotonic logic with various inference rules and depths. |